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Greedy  expansions  in  Banach  Spaces1 


V.N.Temlyakov 

Department  of  Mathematics,  University  of  South  Carolina,  Columbia,  SC  29208 

Abstract.  We  study  covergence  and  rate  of  convergence  of  expansions  of  elements 
in  a  Banach  space  X  into  series  with  regard  to  a  given  dictionary  V.  For  convenience 
we  assume  that  V  is  symmetric:  g  G  V  implies  —g  G  T>.  The  primary  goal  of  this 
paper  is  to  study  representations  of  an  element  f  £  X  by  a  series 

OO 

f  cj(f)gj(f):  9j(f )e£>,  Cj(f)  >  0,  j=  1,2,.... 

3  = 1 

In  building  such  a  representation  we  should  construct  two  sequences:  {gj(f)}j^i  and 
(cj(/)}jCi-  In  this  paper  the  construction  of  {g-j  (/)}jCi  will  be  based  on  ideas  used 
in  greedy-type  nonlinear  approximation.  This  explains  the  use  of  the  term  greedy 
expansion.  We  use  a  norming  functional  Ffm_1  of  a  residual  fm-i  obtained  after 
m—  1  steps  of  an  expansion  procedure  to  select  the  mth  element  gm(f)  G  T>  from  the 
dictionary.  This  approach  has  been  used  in  previous  papers  on  greedy  approximation. 

The  new  feature  of  this  paper  is  a  way  of  selecting  the  mth  coefficient  cm(/)  of  the 
expansion.  An  approach  developed  in  the  paper  works  in  any  uniformly  smooth 
Banach  space.  For  instance,  in  a  Banach  space  X  with  the  modulus  of  smoothness 
p{u)  we  can  choose  cm(/)  from  the  equation 

||/m— l||p(cm(/)/||/ra— ill)  =  “  Cm  (/)  sup  F/m_1(g), 

where  t  G  (0, 1]  is  the  weakness  parameter  of  an  algorithm  and  b  G  (0, 1)  is  its  tuning 
parameter.  We  prove  convergence  of  such  expansions  for  all  /  G  X  and  obtain  rate 
of  convergence  for  /  G  A i(T>)  -  the  closure  (in  X)  of  the  convex  hull  of  T>. 


1.  Introduction 

Let  X  be  a  Banach  space  with  norm  1 1  •  1 1 .  We  say  that  a  set  of  elements  (functions) 
V  from  X  is  a  dictionary  if  each  §6  /  has  norm  one  (||g||  =  1),  and  spanD  =  X. 
In  addition  we  assume  for  convenience  that 

g  G  V  implies  —  g  G  V. 

Thus  from  the  definition  of  a  dictionary  it  follows  that  any  element  /  G  X  can 
be  approximated  arbitrarily  well  by  finite  linear  combinations  of  the  dictionary 

1This  research  was  supported  by  the  National  Science  Foundation  Grant  DMS  0200187  and 
by  ONR  Grant  N00014-91-J1343 
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elements.  The  primary  goal  of  this  paper  is  to  study  representations  of  an  element 
f  E  X  by  a  series 

OO 

(FI)  /  ~  gj(f)eV,  Cj(f)  >  0,  j  =  1,2,.... 

i=i 

In  building  a  representation  (1.1)  we  should  construct  two  sequences:  {<7j(/)}jfLi 
and  {cj(/)}°T1.  In  this  paper  the  construction  of  {gj{f)}jZ=  i  will  be  based  on 
ideas  used  in  greedy-type  nonlinear  approximation  (greedy- type  algorithms).  This 
justifies  the  use  of  the  term  greedy  expansion  for  (1.1)  considered  in  the  paper. 
The  construction  of  {fi,j(/)}|T1  is,  clearly,  the  most  important  and  difficult  part  in 
building  a  represenration  (1.1).  On  the  base  of  contemporary  theory  of  nonlinear 
approximation  with  regard  to  redundant  dictionaries  we  may  conclude  that  the 
method  of  using  a  norming  functional  in  greedy  steps  of  an  algorithm  is  the  most 
productive  in  approximation  in  Banach  spaces.  This  method  has  been  utilized  in 
the  Weak  Chebyshev  Greedy  Algorithm  and  in  the  Weak  Dual  Greedy  Algorithm 
(see  below).  We  use  this  same  method  in  new  algorithms  considered  in  the  paper. 
A  new  qualitative  result  of  the  paper  establishes  that  we  have  a  lot  of  flexibility 
in  constructing  a  sequence  of  coefficients  {c?(/)}(pli-  For  instance,  in  Section  3  we 
make  on  observation  that  at  each  step  of  the  Pure  Greedy  Algorithm  (see  below) 
we  can  choose  a  fixed  fraction  of  the  optimal  coefficient  for  that  step  instead  of  the 
optimal  coefficient  itself.  Surprisingly,  this  leads  to  better  upper  estimates  than 
those  known  for  the  Pure  Greedy  Algorithm  (see  Section  4  for  details). 

We  will  study  in  this  paper  greedy  algorithms  with  regard  to  V  that  provide 
greedy  expansions.  For  a  nonzero  element  /  G  X  we  denote  by  F/  a  norming 
(peak)  functional  for  /: 


Ff  ||  =  1,  *>(/)  =  ll/ll- 


The  existence  of  such  a  functional  is  guaranteed  by  Hahn-Banach  theorem.  Denote 


rv(f)  ■■=  sup  sup  Ff  (g) . 

Ff  g£V 

We  note  that  in  general  a  norming  functional  Ff  is  not  unique.  This  is  why  we  take 
supF/  over  all  norming  functionals  of  /  in  the  definition  of  rp(/).  It  is  known  that  in 
the  case  of  uniformly  smooth  Banach  spaces  (our  primary  object  here)  the  norming 
functional  Ff  is  unique.  In  such  a  case  we  do  not  need  supF/  in  the  definition 
of  rx>(/)-  We  begin  our  discussion  with  the  Weak  Chebyshev  Greedy  Algorithm 
(WCGA)  that  is  the  best  studied.  This  algorithm  does  not  provide  an  expansion. 
However,  the  results  on  converegence  (rate  of  convergence)  for  this  algorithm  may 
serve  as  a  bench  mark  in  the  study  of  convergence  properties  of  expantion  (1.1). 
Then  we  proceed  to  the  Pure  Greedy  Algorithm  (PGA)  and  its  generalization  the 
Weak  Greedy  Algorithm  (WGA)  that  provide  an  expansion  in  Hilbert  spaces.  We 
complete  our  discussion  of  known  results  by  presenting  definitions  of  and  some 
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results  for  natural  generalizations  of  the  PGA  (or  WGA)  to  the  case  of  Banach 
spaces:  the  A-Greedy  Algorithm  and  the  Weak  Dual  Greedy  Algorithm  (WDGA). 
These  algorithms  are  not  as  well  studied  as  either  the  WGA  in  Hilbert  spaces  or  the 
WCGA  in  Banach  spaces.  Finally,  we  turn  to  a  new  modification  of  the  WDGA. 
This  modification,  similarly  to  the  WDGA,  provides  an  expansion.  In  this  paper 
we  prove  convergence  results  for  the  above  mentioned  modification  of  the  WDGA. 
We  note  that  these  results  are  more  general  than  the  known  results  for  the  WDGA. 
We  also  obtain  results  on  the  rate  of  convergence  for  elements  from  the  set  Ai(V) 
that  is  the  closure  (in  X)  of  the  convex  hull  of  V.  We  are  not  aware  of  any  general 
results  on  the  rate  of  convergence  of  the  WDGA  for  elements  from  Ai(T>).  We  also 
note  that  the  new  modification  considered  here  is  even  simpler  than  the  WDGA 
from  the  point  of  view  of  algorithmical  implementation. 

Let  r  :=  {tk}kLi  be  a  given  sequence  of  nonnegative  numbers  f/b  <  1,  k  =  1, _ 

We  define  first  (see  [T3])  the  Weak  Chebyshev  Greedy  Algorithm  (WCGA)  that  is 
a  generalization  for  Banach  spaces  of  Weak  Orthogonal  Greedy  Algorithm  defined 
and  studied  in  [Tf]  (see  also  [DT]  for  Orthogonal  Greedy  Algorithm). 

Weak  Chebyshev  Greedy  Algorithm  (WCGA).  We  define  /q  :=  /g’r  :=  /. 
Then  for  each  to  >  1  we  inductively  define 
!)■  'pm  '  'Pm  e  ®  is  any  satisfying 

2) .  Define 

:=  :=  span{^}™=1, 

and  define  Gcm  :=  G to  be  the  best  approximant  to  /  from  <f>m. 

3) .  Denote 

/c  . _  i»c,T  . _  n 

m  *  J  m  *  J  '-Tra* 

We  consider  here  approximation  in  uniformly  smooth  Banach  spaces.  For  a 
Banach  space  X  we  define  the  modulus  of  smoothness 

p{u)  :=  sup  {]-{\\x  +  uy\\  +  \\x-uy\\)-l). 

Il*ll=lli/ll=i  2 

A  uniformly  smooth  Banach  space  is  one  with  the  property 

lim  p(u)/u  =  0. 

u—¥  0 

It  is  easy  to  see  that  for  any  Banach  space  X  its  modulus  of  smoothness  p(u)  is  an 
even  convex  function  satisfying  the  inequalities 

(1.2)  max(0,  u  —  1)  <  p(u)  <  u,  u  G  (0,  oo). 

It  is  well  known  (see  for  instance  [DGDS],  Lemma  B.l)  that  in  the  case  X  =  Lp , 
1  <  p  <  oo  we  have 

up/p  if  1  <  p  <  2, 

(p  —  l)u2 /2  if  2  <  p  <  oo. 


(1.3) 


p(u)  < 
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It  is  also  known  (see  [LT],  p.63)  that  for  any  X  with  dim  A"  =  oo  one  has 

p(u)  >  (1  +  u2)1/2  -  1 

and  for  every  X ,  dimX  >  2, 

p(u)  >  Cu2,  C  >  0. 

This  limits  power  type  modulus  of  smoothness  of  nontrivial  Banach  spaces  to  the 
case  1  <  q  <  2. 

We  begin  a  discussion  of  known  results  with  a  theorem  on  convergence  of  WCGA 
[T3].  In  the  formulation  of  this  theorem  we  need  a  special  sequence  which  is  defined 
for  a  given  modulus  of  smoothness  p(u)  and  a  given  r  =  {tk}<fX1- 

Definition  1.1.  Let  p(u )  be  an  even  convex  function  on  (— oo,  oo)  with  the  prop¬ 
erty:  p(  2)  >  1  and 

lim  p(u)/u  =  0. 

M— ^  0 

For  any  r  =  {tk}<^=1,  0  <  tk  <  1,  and  0  <9  <  1/2  we  define  :=  ^m(p,r,6)  as  a 
number  u  satisfying  the  equation 

(1.4)  p(u)  =  6tmu. 

Remark  1.1.  Assumptions  on  p(u)  imply  that  the  function 

e(u)  :=  p(u)/u,  u  ^  0,  e(0)  =  0, 

is  a  continuous  increasing  on  [0,  oo)  function  with  e(2)  >  1/2.  Thus  (1-4)  has  a 
unique  solution  0  <  <  2. 

The  following  theorem  and  a  corollary  have  been  proved  in  [T3] . 

Theorem  1.1.  Let  X  be  a  uniformly  smooth  Banach  space  with  the  modulus  of 
smoothness  p(u).  Assume  that  a  sequence  r  :=  {tk.}kLi  satisfies  the  condition:  for 
any  6  >  0  we  have 

OO 

(1.5)  ^2  tmZmipi  T,  9)  =  oo. 

m=  1 

Then  for  any  f  e  X  we  have 

lim  ||/^||=0. 

ra— >-oo 

Corollary  1.1.  Let  a  Banach  space  X  have  modulus  of  smoothness  p(u)  of  power 
type  1  <  q  <  2;  (p(u)  <  yu9).  Assume  that 

OO 

S  C  =  OO,  P= 

m=  1  y 

Then  WCGA  converges  for  any  f  G  X . 

The  following  theorem  has  been  proved  in  [T3]  for  the  WCGA. 
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Theorem  1.2.  Let  X  be  a  uniformly  smooth  Banach  space  with  the  modulus  of 
smoothness  p(u )  <  7 uq ,  1  <  q  <  2.  Then  for  a  sequence  r  :=  {tk}kLi,  tk  <  1, 
k  =  1,  2, . . . ,  we  have  for  any  f  G  Ai(L>)  that 


m 

II/STII<C(?,7)(1  +  E©_1/P'  p-ttT' 

A:  ]  9 

with  a  constant  C(q,ry)  which  may  depend  only  on  q  and  7. 

Theorems  1.1  and  1.2  provide  convergence  results  in  a  very  general  situation: 
X  is  any  uniformly  smooth  Banach  space,  r  is  any  satisfying  (1.5)  (in  particular 
r  =  {t},  t  G  (0,1]).  However,  as  we  already  mentioned  above  the  WCGA  does 
not  provide  an  expansion  (1.1).  We  now  proceed  to  algorithms  that  provide  an 
expansion  (1.1).  Unfortunately,  these  algorithms  are  not  as  good  as  the  WCGA  in 
the  sence  of  convergence. 

Let  us  begin  this  discussion  in  the  special  case  of  a  Hilbert  space  with  the  inner 
product  (•,  •).  We  define  first  the  Pure  Greedy  Algorithm  (PGA)  in  Hilbert  space  H . 
We  describe  this  algorithm  for  a  general  dictionary  V.  If  /  G  H ,  we  let  g(f )  G  V  be 
an  element  from  V  which  maximizes  (/,  g).  We  will  assume  for  simplicity  that  such 
a  maximizer  exists;  if  not  suitable  modifications  are  necessary  (see  Weak  Greedy 
Algorithm  below)  in  the  algorithm  that  follows.  We  define 

G(f,V)  :=  tf,g(f))g(f) 

and 

f?(/,D)  :=f-G(f,V). 

Pure  Greedy  Algorithm  (PGA).  We  define  Ro(f,V)  :=  /  and  Go(f,V)  :=  0. 
Then,  for  each  m  >  1,  we  inductively  define 

Gm(f ,  V)  :=  Gm-l(f,  V)  +  G(Rm-l(f,  V),V) 

Rm(f,V)  :=f-  Gm(f,V )  =  R(Rm-i(f ,V),V). 

Let  a  sequence  r  =  0  <tk<  1,  be  given.  Following  [Tl]  we  define  the 

Weak  Greedy  Algorithm. 

Weak  Greedy  Algorithm  (WGA).  We  define  /q  :=  /.  Then  for  each  m  >  1, 
we  inductively  define: 

1 ).  (p^  G  V  is  any  satisfying 

</m-HPm>  >trn  SUp (fa-l,  g)\ 

g£V 

/T  . _  nT 

m  *  J  ra—1 


«;■ 
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3). 

m 

Grm(f,T>)  -YtUi-i’fWj- 

3  = 1 

We  note  that  in  a  particular  case  tk  =  t,  k  =  1,2,...,  this  algorithm  was 
considered  in  [ J] .  Thus,  the  WGA  is  a  generalization  of  the  PGA  in  the  direction 
of  making  it  easier  to  construct  an  element  tpTm  at  the  mth  greedy  step.  We  point 
out  that  the  WGA  contains,  in  addition  to  the  first  (greedy)  step,  the  second  step 
(see  2),  3)  in  the  above  definition)  where  we  update  an  approximant  by  adding  an 
orthogonal  projection  of  the  residual  ffn_  1  onto  Therefore,  the  WGA  provides 
for  each  /  £  H  an  expansion  into  a  series  (greedy  expansion) 


3  = 1 

In  general  it  is  not  an  expansion  into  an  orthogonal  series  but  it  has  some  similar 
properties.  The  coefficients  Cj(f )  of  an  expansion  are  obtained  by  the  Fourier 
formulas  with  /  replaced  by  the  residuals  fj  1.  It  is  easy  to  see  that 

ll/^H2  =  ll/^il|2-|cm(/)|2. 

In  the  case  of  convergent  greedy  expansion  (see,  for  instance,  Theorem  1.3  below)  we 
get  for  this  expansion  an  analog  of  the  Parseval  formula  for  orthogonal  expansions: 

OO 

ii/ii2  =  Em/)  i2- 

3  = 1 


We  proved  in  [T2]  a  criterion  on  r  for  convergence  of  WGA.  To  explain  this  we 
need  some  notation. 

We  define  by  V  the  class  of  sequences  x  =  {xk}kLi,  Xk  >  0,  k  =  1,  2, . . . ,  with 
the  following  property:  there  exists  a  sequence  0  =  qo  <  q\  <  . . .  such  that 


E 


2s 

A  qs 


<  oo; 


and 

oo  qs 

< 00  ’ 

s=l  k=  1 

where  A qs  :=  qs  -  qs  i- 

Theorem  1.3.  The  condition  r  ^  V  is  necessary  and  sufficient  for  convergence  of 
Weak  Greedy  Algorithm  with  weakness  sequence  r  for  each  f  and  all  Hilbert  spaces 
H  and  dictionaries  V. 


For  a  general  dictionary  V  we  define  the  class  of  functions 
A°{V,  M )  :=  {/  G  H  :  f  =  ^  ckwk ,  wk  &  T>,  #A  <  oo  and  ^  \ck\  <  M} 

k£ A  k£ A 
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and  we  define  Ai(T>,  M)  as  the  closure  (in  X )  of  A°(T>,  M).  Furthermore,  we  define 
Ai(V)  as  the  union  of  the  classes  Ai(V,M)  over  all  M  >  0.  For  /  G  Ai(T>),  we 
define  the  norm 

l/Ui  (p) 

as  the  smallest  M  such  that  /  G  A\{V,M). 

It  was  proved  in  [DT]  that  for  a  general  dictionary  V  the  Pure  Greedy  Algorithm 
provides  the  following  estimate 

(1-6)  ll/-Gm(/,U)||  <  | f\A,(v)m-1,e- 

(In  this  and  similar  estimates  we  consider  that  the  inequality  holds  for  all  possible 
choices  of  {Gm}.)  We  proved  in  [KT]  an  estimate 

(1-7)  ||/-Gm(/,»)|| 

which  improves  a  little  the  original  one  (see  (1.6)). 

Recently,  we  proved  in  [LiT]  that  there  exist  a  dictionary  V  and  an  element 
f  &  H ,  f  A  0,  such  that 

(1.8)  11/  -  G„(/,C)||  >  Cm-027\f\Aim 

with  a  positive  constant  C. 

Much  less  is  known  about  greedy  expansions  with  regard  to  general  redundant 
dictionaries  in  the  case  of  a  general  Banach  space  X.  We  discuss  next  two  versions 
of  generalization  of  PGA  from  a  Hilbert  space  H  to  a  Banach  space  X.  The  first 
one  is  a  straightforward  generalization  of  PGA.  We  call  it  Pure  Greedy  Algorithm 
or  Af-Greedy  Algorithm  when  we  want  to  indicate  a  Banach  space.  For  a  given  X 
and  V  we  define  G(f,V,X)  :=  a(f)g(f )  where  a(f)  G  K  and  g(f)  G  V  satisfy  (we 
assume  existence)  the  relation 

min  ||/  -  ag\\  =  \\f  -  a{f)g{f)\\. 

a£R,g£T> 

X-Greedy  Algorithm.  We  define  Ro(f,V,  X)  :=  /  and  Go(f,V,  X)  :=  0.  Then, 
for  each  m  >  1,  we  inductively  define 

Rm(f )  :=  Rm{f,V,X)  :=  Rm-l(f)  G(Rm  !  (/) ,  V,  X) 

Gm(f ,  V,  X)  :=  Gm_!(/,  V,  X)  +  G(Rm^(f),  V,  X). 

The  second  version  of  PGA  in  a  Banach  space  is  based  on  the  concept  of  norming 
functional.  We  call  it  the  Dual  Greedy  Algorithm  (DGA).  Let  a  dictionary  V  in  X 
be  given.  Take  an  element  /  G  X  and  find  a  norming  functional  Ff.  Now  the  basic 
step  of  PGA  is  modified  to  the  following.  Assume  that  there  exists  gf  G  D  such 
that 

Ff(9f )  =  ma xFf{g). 
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We  take  this  gg  and  solve  one  more  optimization  problem:  find  a  number  a  such 
that 

11/  -  agj\\x  =  min  ||/  -  bgf  \\x. 

b 

We  put 

GD(f,V)  :=agf,  RD(f,  V) -.=  f  -  ag,. 

Repeating  this  step  m  times  we  get  as  an  approximant  and  i?,/J(/,  V)  as 

a  residual. 

Let  us  give  a  definition  of  the  Weak  Dual  Greedy  Algorithm  (see  [T4,p.66]). 

Weak  Dual  Greedy  Algorithm  (WDGA).  We  define  f\f  :=  f^'T  :=  f .  Then 
for  each  m  >  1  we  inductively  define 
!)■  '■=  Tm,T  is  any  satisfying 

(!-9)  Ffn  {<(%)>  tmTvtfn-l)- 

J  m  —  1 

2) .  Define  am  as 

ll/m-1  -  amV°  II  =  min  II /^_!  -  acp°  ||. 

CL  £1R 

3) .  Denote 

fD  fD,T  fD  _  n  inD 

It  is  clear  that  in  the  case  r  =  {1}  the  WDGA  coincides  with  the  DGA  defined 
above.  The  following  conjecture  has  been  formulated  in  [T4,p.73,  Open  problem 
4.3]:  the  Dual  Greedy  Algorithm  converges  for  all  dictionaries  V  and  each  element 
/  G  X  in  uniformly  smooth  Banach  spaces  X  with  modulus  of  smoothness  of  fixed 
power  type  q,  1  <  q  <  2,  (p(u)  <  yu9). 

Recently,  M.  Ganichev  and  N.J.  Kalton  [GK]  have  proved  the  following  very 
interesting  result. 

Theorem  1.4.  Let  r  =  {t},  t  e  (0, 1]  and  X  =  Lp,  1  <  p  <  oo.  Then  the  WDGA 
converges  for  any  dictionary  V  for  all  functions  f  E  Lp. 

We  consider  here  a  modification  of  the  WDGA  that  is  a  little  simpler  than  the 
WDGA.  One  more  good  feature  of  this  new  modification  is  that  we  can  prove  its 
convergence  in  every  uniformly  smooth  Banach  space.  In  addition  to  this  we  obtain 
good  rate  of  convergence  of  it  for  elements  from  AfiV).  We  note  that  other  greedy- 
type  algorithms  in  Banach  spaces  have  been  recently  introduced  and  studied  by 
E.D.  Livshitz  [L], 

We  begin  with  a  description  of  a  general  scheme  that  provides  an  expansion  for 
a  given  element  /.  Later,  specifying  this  general  scheme,  we  will  obtain  different 
methods  of  expansion. 
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Dual  Based  Expansion  (DBE).  Let  t  £  (0,1]  and  f  ^  0.  Denote  fo  :=  f. 
Assume  {fj}™^1  C  X,  C  ©  and  a  set  of  coefficients  {cj}”^1  of  expansion 

have  already  been  constructed.  If  frn  i  =  0  then  we  stop  ( set  Cj  =  0 ,  j  =  m,m  + 
1, . . .  m  the  expansion)  and  get  f  =  J^li1  cj  ■  U  fm- 1  7^  0  then  we 
1 ).  choose  pm  £  "D  snc/i  that 

Ffm-AVm)  >  trD{fm- 1); 

Sj.  define 

fm  • —  fm—  1  CmPmi 

where  cm  >  0  is  a  coefficient  either  prescribed  in  advance  or  chosen  from  a  concrete 
approximation  procedure. 

We  call  the  series 

OO 

(LiO) 

3= 1 

the  Dual  Based  Expansion  of  f  with  coefficients  Cj(f )  :=  Cj,  j  =  1,  2, . . .  with  regard 
to  V. 


Denote 


Then  it  is  clear  that 


Sm(f,T>)  :=Y,cm. 

3= 1 


fm  =  f~Sm(f,V). 


We  prove  some  convergence  results  for  the  DBE  in  Sections  2  and  3.  In  Section  3 
we  consider  a  variant  of  the  Dual  Based  Expansion  with  coefficients  chosen  by  a 
certain  simple  rule.  The  rule  depends  on  two  numerical  parameters  t  £  (0, 1]  (the 
weakness  parameter  from  the  definition  of  the  DBE)  and  b  £  (0, 1)  (the  tuning 
parameter  of  the  approximation  method).  The  rule  also  depends  on  a  majorant  p 
of  the  modulus  of  smoothness  of  the  Banach  space  X . 


Dual  Greedy  Algorithm  with  parameters  (t,b,/x)  (DGA (t,b,/i)).  Let  X  be 
a  uniformly  smooth  Banach  space  with  the  modulus  of  smoothness  p(u )  and  let  ffiu) 
be  a  majorant  of  p(u):  p(u)  <  ffiu),  u  £  [0,  00).  For  parameters  t  £  (0, 1],  b  £  (0, 1) 
we  define  sequences  {/m}^=0,  {pm}m=  i>  {c™}m=i  inductively.  Let  f0  :=  f.  If  for 
m  >  1  fm- 1  =  0  then  we  set  fj  =  0  for  j  >  m  and  stop.  If  fm-i  7^  0  then  we 
conduct  the  following  three  steps: 

1 ) .  take  any  pm  £  D  such  that 

(1-11)  Ffm_1(pm)>trv(fm- 1); 

2) .  choose  cm  >  0  from  the  equation 

(1-12)  ||/m-l||M<WI|/m-l||)  =  Y CmTvifm-1 )i 

3) .  define 

(1-13)  fm  • —  fm—  1  CmPm- 

In  Section  3  we  prove  the  following  convergence  result. 
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Theorem  1.5.  Let  X  be  a  uniformly  smooth  Banach  space  with  the  modulus  of 
smoothness  p(u )  and  let  p{u)  be  a  majorant  of  p(u)  with  the  property  p{u)/u  f  0  as 
u  — *  +0.  Then  for  any  t  E  (0, 1]  and  b  E  (0, 1)  the  DGA(t ,  b,  p)  converges  for  each 
dictionary  V  and  all  f  E  X . 

The  following  result  from  Section  3  gives  the  rate  of  convergence. 

Theorem  1.6.  Assume  X  has  a  modulus  of  smoothness  p(u)  <  7 uq ,  q  E  (1,2]. 
Denote  p(u)  =  7 uq .  Then  for  any  dictionary  V  and  any  f  E  Ai(V)  the  rate  of 
convergence  of  the  DGA(t,b,  p)  is  given  by 

1 1  fm  1 1  <  C{t,b,i,q)m~  ,  p:=_A_. 

2.  Convergence  of  the  Dual  Based  Expansion 
We  begin  with  the  following  lemma. 

Lemma  2.1.  Let  f  E  X.  Assume  that  the  coefficients  of  the  expansion 

00  m 

f  ~  C3  T j  i  fm  ■=  f  ~  CjTj 

3= 1  3= 1 

satisfy  the  following  two  conditions 

OO 

(2.1)  ^CjrvUj- i)<oo, 

3= 1 


00 


(2.2) 

y  c3 = °°- 

j=i 

Then 

(2.3) 

liminf  ||/m||  =  0 

ra— ^o 0 

Proof.  The  proof  of  this  lemma  is  similar  to  the  proof  of  Lemma  1  from  [GK], 
Denote  sn  :=  Y^j=\cj-  Then  (2.2)  implies  (see  [B,p.904])  that 

OO 

(2.4)  y,  Cn/Sn  =  OO. 

71=  1 

Using  (2.1)  we  get 


OO  OO 

^  ^  Sn'T'D  (yfn  —  1  )^n  /  ^  ^  Cn'P'D  (fn  —  l) 

n= 1  n=l 


<  OO. 
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Thus  by  (2.4) 


liminf  snrv(fn-i)  =  0 


and  also  (sn_i  <  sn ) 

liminf  snrv(fn)  =  0. 

n—too 

Let 


(2.5) 


lim  snkrv(f„J  =  0. 

/e— >-oo 


Consider  {Ff  }•  The  unit  sphere  in  the  dual  X*  is  weakly*  compact  (see  [HHZ,p.45]). 
Let  Fj  :=  Ffn fe  be  a  w* -convergent  subsequence.  Denote 

F  :=  w*  -  lim  Ft. 

i—y  oo 


We  will  complete  the  proof  of  Lemma  2.1  by  contradiction.  We  assume  that  (2.3) 
does  not  hold:  3a  >  0  and  31V  G  N: 


(2.6)  ||/m||>a,  m  >  N, 

and  will  get  a  contradiction. 

We  begin  by  deriving  from  (2.6)  that  F  ^  0.  Indeed,  we  have 
(2-7)  F(f)  =  lim  Fi(f) 


and 


Tlk  .  Tlfc  . 

(2.8)  Fi(f)  =Fi(fnk .  +Y^Cj(pj)  =  Wfn^W  +  Y^cjFifoj)  >  a  -  snk.rv{fnk.) 

i=i  l=i 

for  big  i.  Relations  (2.7),  (2.8),  and  (2.5)  imply  that  F(f)  >  a  and,  hence  F  ^  0. 
This  implies  that  3g  G  V  :  F(g)  >0.  However, 

F(g)  =  lim  F{(g)  <  lim  rv{fnk,)  =  0. 

% — ^  oo  % — yoo  % 

We  got  a  contradiction  that  completes  the  proof  of  Lemma  2.1. 

Let  us  now  consider  a  variant  of  the  Dual  Based  Expansion  when  the  coefficient 
sequence  C  =  {cj}°?=1  is  prescribed  in  advance  and  does  not  depend  on  /.  We  will 
call  such  a  procedure  the  Weak  Dual  Greedy  Approximation  with  coefficients  C 
(WDGA(C)). 
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Theorem  2.1.  Let  X  be  a  uniformly  smooth  Banach  space  with  the  modulus  of 
smoothness  p(u).  Assume  C  =  {cj}jT1  is  such  that 


and  for  any  y  >  0 


=  oo, 


(2.9)  J2p{ycj)<  oo. 

3  =  1 

Then  for  the  Dual  Based  Expansion  of  any  f  E  X  with  coefficients  C  with  regard  to 
any  dictionary  V  we  have 

(2.10)  liminf  ||/m||  =  0. 

ra— >-oo 


Proof.  The  proof  is  by  contradiction.  Assume  (2.10)  does  not  hold.  Then  3a  >  0 
and  31V  E  N  such  that  for  all  m  >  IV 

||/m||  >  OL  >  0. 

From  the  definition  of  the  modulus  of  smoothness  we  have 

(2-11)  1 1  fn  —  l  ~  Cn(fn  ||  +  |  \fn—  1  +  CnPn\\  <  2||/n_i||(l  +  p(cn/ \ \ fn  \  \  \ )  ) . 

Using  the  definition  of  ipn: 

(2-12)  Ffn-i{<Pn)  >  trv{fn-i) 

we  get 

(2.13)  1 1  /n  —  1  3“  C"n  Pn  \  \  A  1'/,,  ]  ( fn—l  3“  Cn(pn) 

—  ||/n  —  1 1|  3“  CnFfn_1  (pn)  P  1 1 /n  — 1 1 1  3"  Cnt?’X>  (/n  — 1 ) • 

Combining  (2.11)  and  (2.13)  we  get 

(2.14)  1 1  fn  1 1  =  1 1  fn  —  l  -  Cnpn\\  <  ||/n-l||(l  3“  2p(cn/ 1 1  /„_  1 1 1 )  )  -  CntrV(fn_  i). 

We  note  that  by  Remark  1.1 

||/n-l||p(Cn/||/n-l||)  <  CXp(cn/a),  71  >  N. 

Therefore,  by  the  assumption  (2.9) 

OO 

(2-15)  ll/n-l||p(Cn/||/n-l||)  <  OO. 

n= 1 

This  and  (2.14)  imply 

OO  OO 

^Cnr^(/n_i)  <  f^GI/H  +  2^  H/n-illp^/ll/n-lID)  <  OO. 
n= 1  n= 1 

It  remains  to  apply  Lemma  2.1  to  complete  the  proof. 
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3.  A  MODIFICATION  OF  THE  WEAK  DUAL  GREEDY  ALGORITHM 

We  begin  this  section  with  a  proof  of  Theorem  1.5.  We  give  a  definition  of  the 
DGA (r,b,n),  r  =  {tfcjfcLu  tk  G  (0,1]  here. 

Dual  Greedy  Algorithm  with  parameters  (r,  6,  p)  (DGA(r,6,/i)).  Let  X 

be  a  uniformly  smooth  Banach  space  with  the  modulus  of  smoothness  p(u )  and  let 
p(u)  be  a  majorant  of  p(u):  p(u)  <  p(u),  u  G  [0,  oo).  For  a  sequence  r  =  {tk}kLu 
tk  G  (0,1]  and  a  parameter  b  G  (0,1)  we  define  sequences  {fm}m=o>  {(Pm}m=  i> 
{ cm } m—i  inductively.  Let  fo  :=  f.  If  for  m  >  1  fm- 1  =  0  then  we  set  fj  =  0  for 
j  >  to  and  stop.  If  fm-i  0  then  we  conduct  the  following  three  steps: 

1 ) .  take  any  pm  G  D  such  that 

(3-1)  Ffm_1(iprn)  >  trnr'p(frn— i); 

2) .  choose  cm  >  0  from  the  equation 

(3.2)  H/m-lMCm/ll/m-lll)  =  (/m-l)  ! 

3) .  define 

(3.3)  fm  •  fm—  1  pm  ■ 


Proof  of  Theorem  1.5.  In  this  case  r  =  {t},  t  G  (0, 1].  We  have  by  (2.14) 

(3.4)  ||/m||  =  1 1  fm—  1  Cm (fimW  ^  ||/m  —  1 1 1  ( 1  T  2p(cm/||/m_i  I)))  Cmtrx>  (fm  —  l)  - 


Using  the  choice  of  cm  we  get  from  here 

(3.5)  1 1  fm  1 1  <  |  \fm—  1 1 1  -  t(  1  -  b)cmrv{fm- 1)- 

In  particular,  (3.5)  implies  that  {||/m||}  is  a  monotone  decreasing  and 

f(l  -  b)cmrv(fm- 1)  <  | \fm  —  1 1 1  -  ||/m||. 


Thus 

OO 


(3.6) 


>  CmVvUni-  l)  <  CO. 
m=  1 


We  have  the  following  two  cases: 

OO 

(II)  ^  Cm  <  OO- 

m=l 


oo 

(/)  ^  ^  —  (X), 

m=  1 
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In  the  first  case  by  Lemma  2.1  we  obtain 

liminf  ||/m||  =  0  lim  ||/m||  =  0. 

m— >•  oo  ra— ^oo 

It  remains  to  consider  the  case  (II).  We  prove  convergence  in  this  case  by  contra¬ 
diction.  Assume 


(3.7) 


lim  ||/m||  =  a  >  0. 


By  (II)  we  have  fm  — »  ^  0  as  m  — *  oo.  We  note  that  by  uniform  smoothness  of 

X  we  get 

lim  III71/-  —Ft  11=0. 

m-S-oo  "  Tm  /ooM 

We  have  Ffx  /  0  and  therefore  there  is  a  g  £  V  such  that  Ffoa(g)  >  0.  However, 
(3-8)  Ffoo  (g)  =  lim  Ffm{g)<  lim  rv{fm)  =  0. 

ra— >•  oo  ra— >•  oo 

Indeed,  by  (3.2)  and  (3.7)  we  get 


1  ^ 

rvifm- 1)  <  acm  g(cm/a)  —  — >■  0 


as  to  — >■  oo. 

Theorem  1.5  is  proved. 

We  proceed  to  studying  the  rate  of  convergence  of  the  DGA(r,  b,  p)  in  the  uni¬ 
formly  smooth  Banach  spaces  with  the  power  type  majorant  of  the  modulus  of 
smoothness:  p(u)  <  p(u)  =  yu9,  1  <  q  <  2.  We  now  prove  a  statement  more 
general  that  Theorem  1.6. 

Theorem  3.1.  Let  r  :=  {ffcjfcli  be  a  nonincreasing  sequence  1  >  ti  >  t2  ■  ■  ■  >  0 
and  b  6  (0,1).  Assume  X  has  a  modulus  of  smoothness  p(u)  <  yu9,  q  6  (1,2]. 
Denote  p(u)  =  y uq .  Then  for  any  dictionary  V  and  any  f  e  Ai(V)  the  rate  of 
convergence  of  the  DGA(r,b,  p)  is  given  by 

m 

■  m  t  ytl  ( 1  —  b)  Ft 

\\fm\\  <  C'(&,y,g)(l  +  J^r*’<1+t™<1-b»,  P:=^y- 

k= i  ^ 


Proof.  Similar  to  (3.5)  we  get 

(3.9)  ||/m||  <  ll/m— 1 II  -  tm(l  ~  b)cmrv{fm.-l)- 
Thus  we  need  to  estimate  from  below  cmrx>(/m_ 1)-  It  is  clear  that 

m—  1  m—  1 

(3.10)  ||/m-l|Ui(X>)  =  11/  -  CjVjWA-tpD)  <  ||/IUi(X>)  +  ^  Cj. 
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Denote  bn  :=  1  +  Xq=i  cj ■  Then  by  (3.10)  we  get 

1 1  fm—  1 1 1  A.1  ((D)  km  —  1- 

Next,  by  Lemma  2.2  from  [T3]  we  get 

(3-11)  rnifm-i)  =  SX1P  Ffm_1(g)  =  sup  T/m_1(<p) 

g&'D  ^>eA1(v) 

—  ||/m-l  ll^.1(X>)T1/m_1  (/m-l)  >  ||/m-l  ||/^m-l- 

Substituting  (3.11)  into  (3.9)  we  get 

(3.12)  ||/m||  <  ||/m_i||(l  -  tm(  1  -  6)cm/6m_i). 

From  the  definition  of  brn  we  find 

bm  br Ti—l  "F  Cm  6m_i(l  T  Cm/bm  —  l)- 

Using  the  inequality 

(1  +  x)a  <  1  +  ax,  0  <  a  <  1,  x  >  0, 


we  obtain 

(3.13)  ^(r-6)  <6Mi-fc)(i  +  tm(i_6)Cm/6m  x) 

Multiplying  (3.12)  and  (3.13)  and  using  that  tm  <  fm_i  we  get 

(3.14)  WUWW'-v  <  \\fm-i\\b‘™:l(1-b)  <  ll/ll  <  1. 

The  function  p(u)/u  =  7 u^1  is  increasing  on  [0,  00).  Therefore  the  cm  from  (3.2) 
is  greater  than  or  equal  to  c'm  from  (see  (3.11)) 

(3.15)  7ll/m-l  ll(Cm/ll/m-lll)9  =  1 1  fm_  ,  \  \  /bm_  j , 


(3.16) 


=  (; 


27 


b  ^ 
)q~ 


-Ah 


Q 

q-1 


1 

L-3-1 
Jm- 1 


Using  notations 


p  := 


q-  1’ 


A-1  :=(l-6)(-)^<l/2, 

27 
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we  get  from  (3.9),  (3.11),  (3.16) 

tp  Ilf  Jlp 

(3-17) 

A  °rn- 1 

Noting  that  brn  >  bm  i  we  derive  from  (3.17)  that 

(3.18)  (iimi/M"  <  oi/m-iii/6m-i)p(i  -  -v'cai/m-iiiAn-in- 

Taking  into  account  that  ||/||  <  1  <  A  we  obtain  from  (3.18)  by  Lemma  3.1  from 
[Tl] 

m 

(3.19)  (\\U\/bmr<A(l  +  '£tl)-1. 


Combining  (3.14)  and  (3.19)  we  get 


||/m||  <  C7(6,7,g)(l  +  J^ffc) 

k= 1 


tm  (1  ~ b) 

P(l  +  *m  (1—b)) 

? 


P  := 


9 

9-1' 


This  completes  the  proof  of  Theorem  3.1. 

In  the  case  r  =  {t},  t  G  (0, 1]  we  get  Theorem  1.6  from  Theorem  3.1. 

It  follows  from  the  proof  of  Theorem  3.1  that  it  holds  for  a  modification  of 
the  DGA(r,6,/i)  where  we  replace  in  the  definition  the  quantity  rx>(fm-i)  by  its 
lower  estimate  (see  (3.11))  ||/m-i||/6m-i  with  bm  i  :=  1  +  ^2'jLi  cj ■  Clearly,  this 
modification  is  more  ready  for  practical  implementation  than  the  DGA(r,  6,  n).  We 
formulate  the  above  remark  as  a  separate  result. 

Modified  Dual  Greedy  Algorithm  (r,  6, //)  (MDGA(r,6,/i)).  Let  X  be  a  uni¬ 
formly  smooth  Banach  space  with  the  modulus  of  smoothness  p(u )  and  let  p(u)  be  a 
majorant  of  p(u):  p(u)  <  p(u),  u  G  [0,  oo).  For  a  sequence  r  =  {tk}kLi,  tk  G  (0, 1] 
and  a  parameter  b  G  (0, 1)  we  define  for  f  G  A\{V)  sequences  {fm}m=o>  Wm}m=  i> 
{ cm. } m=  i  inductively.  Let  fo  :=  f .  If  for  m  >  1  fm-i  =  0  then  we  set  fj  =  0  for 
j  >  to  and  stop.  If  fm- 1  ^  0  then  we  conduct  the  following  three  steps: 

1 ).  take  any  G  D  such  that 


Ffm- li.Frn)  h  tm  1 1  f m  —  1 1 1  ( 1  + 


m  l 

£■ 

i=i 


2).  choose  cm>  0  from  the  equation 


fl(cm/||/m—  1 1|) 


tm.  b 


m—  1 

,.(i  +  ^2  c) 

i=i 


fm  • —  fm—  1  Cm^fir 


3).  define 
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Theorem  3.2.  Let  r  :=  be  a  nonincreasing  sequence  1  >  t\  >  t2  ■  ■  ■  >  0 

and  b  G  (0,1).  Assume  X  has  a  modulus  of  smoothness  p(u )  <  ^uq ,  q  G  (1,2]. 
Denote  p(u)  =  yw9.  Then  /or  any  dictionary  V  and  any  f  G  Ai(T>)  the  rate  of 
convergence  of  the  MDGA(r,b,  p)  is  given  by 

m 

■  m  t  ‘YTX  (  1 -  b)  ff 

ll/mll  <  C(b,j,q)(  1  +  p:=^— . 

£7  "-1 

Let  us  discuss  an  application  of  Theorem  1.6  in  the  case  of  Hilbert  space.  It  is 
well  known  and  easy  to  check  that  for  a  Hilbert  space  H  one  has 

p(u)  <  (1  +  u2)1/2  —  1  <  u2 / 2. 

Therefore,  by  Theorem  1.6  with  p(u)  =  u2 / 2  the  DGA(f,  b,  p)  provides  the  following 
error  estimate 

(3.20)  ||/™||  <  for  /  G  A^V). 

The  estimate  (3.20)  with  t  =  1  gives 

(3.21)  \\fm\\  <C(b)m-^  for  /  G  AX(V). 

The  exponent  2{2-b)  estiixisit e  is  approaching  1/4  with  b  approaching  0. 

Comparing  (3.21)  with  the  upper  estimates  (1.6)  and  (1.7)  for  the  PGA  we  observe 
that  the  DGA(1,  6,  u2 / 2)  with  small  b  has  better  upper  estimate  for  the  rate  of  con¬ 
vergence  than  the  known  estimates  for  the  PGA.  We  note  also  that  (1.8)  indicates 
that  the  exponent  in  the  power  rate  of  decay  of  error  for  the  PGA  is  less  than  0.27. 

Let  us  figure  out  how  the  DGA(1,  6,  u2/2)  works  in  Hilbert  space.  Consider  the 
mth  step  of  it.  Let  ipm  G  V  be  from  (1.11).  Then  it  is  clear  that  (pm  maximizes 
the  (fm-i,g)  over  the  dictionary  V  and 

{fm  —  li  d)  —  ||/m—  1  ||G?(/m—  l)- 

The  PGA  would  use  (pm  with  the  coefficient  (fm- 1,  d)  at  this  step.  The  DGA(1,  6,  u2 / 2) 
uses  the  same  ipm  and  only  a  fraction  of  (/m_ i,g): 

(3.22)  Cm  =  b\\fm-l\\Mfm-l). 

Thus  the  choice  b  =  1  in  (3.22)  corresponds  to  the  PGA.  However,  it  is  clear  from 
the  above  considerations  that  our  technique,  designed  for  general  Banach  spaces, 
does  not  work  in  the  case  6  =  1.  The  above  discussion  brings  us  the  following 
surprising  observation.  The  use  of  a  small  fraction  (cm  =  b(fm-i,g))  of  an  optimal 
coefficient  results  in  improvement  of  the  upper  estimate  for  the  rate  of  convergence. 
We  present  some  more  results  in  this  direction  in  the  next  section. 
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4.  The  Weak  Greedy  Algorithm  with  parameter  6 

Motivated  by  results  of  Section  3  we  consider  here  a  generalization  of  the  WGA 
obtained  by  introducing  to  it  a  tuning  parameter  b  G  (0,1].  Using  specifics  of 
Hilbert  space  structure  we  will  prove  more  precise  estimates  that  those  obtained 
from  the  general  theory  developed  in  Section  3.  Let  a  sequence  t  =  {tk}kLi, 
0  <  tk  <  1  and  a  parameter  b  G  (0, 1]  be  given.  We  define  the  Weak  Greedy 
Algorithm  with  parameter  b. 

Weak  Greedy  Algorithm  with  parameter  b  (WGA (b)).  We  define  /q’6  :=  /. 
Then  for  each  m  >  1 ,  we  inductively  define: 

1 ).  £Vis  any  satisfying 


2). 

3). 


(/m6  1.  ^m6)  >  tm  SUp  (/£*  j  ,  g)  J 
g£V 


G^b(f,V)  :=b'£(fJ-\,<P?b)<P? 

3  =  1 


Theorem  4.1.  Let  r  ^  V.  Then  the  WGA(b)  with  b  G  (0, 1]  converges  for  each  f 
and  all  Hilbert  spaces  H  and  dictionaries  V. 

Proof.  In  the  case  6=1  the  statement  is  proved  in  [T2]  (see  Theorem  1.3  from  the 
Introduction  of  this  paper).  In  the  case  b  G  (0, 1)  the  proof  repeats  the  proof  from 
[T2]  and  [Tl]  with  the  relation 


\\fTm\\2  =  u, 


T 

m 


-</, 


T 

m 


1  ’  Tm! 


replaced  by 


wrJf  =  ii/, 


b\2 


m—  1 1 


-6(2 -&)</£• 


We  will  not  carry  it  out  here. 

We  proceed  to  the  rate  of  convergence. 

Theorem  4.2.  Let  V  be  an  arbitrary  dictionary  in  H.  Assume  r  :=  {tk}kLi  is  a 
nonincreasing  sequence  and  b  G  (0, 1].  Then  for  f  G  AifiD)  we  have 


(4.1)  \\f  -GTJ{f,V)\\  <  (1  +  6(2  —  b)  ^  £2)-(2-6)tm/2(2+(2-6)tm). 

k= 1 


Proof.  We  introduce  some  notations: 


ar 


■■=  ii/; 


1 1 2 


Vm  ■■=  {f™-i,T™b),  m  =  1,2, 
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and  consider  the  sequence  {6n}  defined  as  follows 

bo  :=  1,  bm  :=  bm-i  +  bym,  m  =  1,2, - 

It  is  clear  that  f^,b  G  A^V.bn).  By  Lemma  3.5  from  [DT]  we  get 


SUP  (fn-nd)  >  1 1  /m  —  1 1 1 2 /bm—  1  • 

g£V 


From  here  and  from  the  equality 


ll/m&l|2  =  ll/m&  ill2  —  b{2  ~  b)(fm-l,  ^m) 


T,b  _  r,b\2 


we  obtain  the  following  relations 


®ra  —  ®ra- 1  6(2  6)l/m, 


bm.  —  bm—  1  +  by  mi 


Vm  id  tm(^m  —  l/bm  —  l- 


From  (4.3)  and  (4.5)  we  get 


®m  +  Q>m— i(l  6(2  6)tmam_i6m_1). 


Using  that  6m  i  <  bm  we  derive  from  here 


um6m  +  um_i6m_1(l  6(2  6)tmam_i6m_1). 


By  Lemma  3.1  from  [Tl]  with  A  =  1  we  obtain 


(4.6)  am6m2<(l  +  6(2-6)^62fc)-1. 

k=i 

The  relations  (4.3)  and  (4.5)  imply 

(4.7)  Clm  +  CLm—  1  6(2  b)ymtm.Clm.-l/bm-l  =  Q>m—  l(l  6(2  6)tm?/m /bm—  1 ) • 

Using  the  inequality  (1  —  a:)1/2  <  1  —  x/2  we  get  from  (4.7) 

(4.8)  aj/2  <  a,L/2i(l  -  6(1  -  6/2)tm?/m/6m_i). 

Rewriting  (4.4)  in  the  form 


bm.  — 


bm  1  (1  +  6?/  m / bm  1 )  5 
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and  using  the  inequality 

(1  +  x)a  <  1  +  ax,  0  <  a  <  1,  x  >  0, 
we  get  from  (4.9)  that 


(4.10)  (1  +  6(1  -  b/2)tmyrn/brn-i), 

Multiplying  (4.8)  and  (4.10)  we  obtain 

i/2h{i-b/2)tm  <  1/2  h(i-b/2)tm 


Next,  6,m_i 


>  1  and  tm 


<  tm  i .  Therefore 


7  (1  b/2)tm  i(l  b/2)tm-1 
°m- 1  —  °m- 1 


and 

(4.11)  <  <  %/2  <  I- 

Combining  (4.6)  and  (4.11)  we  obtain 


a. 


l+(l-6/2)t„ 


<  (1  +  6(2  -  *)  XI*!) 


-(l-6/2)t„ 


fc=l 


what  completes  the  proof. 

Remark  4.1.  It  follows  from  the  proof  of  Theorem  f.l  that  it  holds  for  a  modi¬ 
fication  of  the  WGA(b)  obtained  by  replacing  in  its  definition  supg£V(fffb_1,  g)  by 

1 1  frn—  1 1 1 2  /6m— i  j  where  brn  i  :=  1  +  6  Tj,b)- 
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